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ABSTRACT 
As  the  ARCH  model  has  emerged  as  an  important  innovation  for  modeling  the  second  mo- 
ment of  a  random  variable  conditional  on  the  information  set,  increasing  concern  has  been 
directed  to  the  formulation  of  conditional  variance  function.  In  order  to  provide  a  unified 
approach  to  the  problem  of  exploring  the  stationarity  conditions  and  the  test  statistics  for 
various  specifications  of  conditional  heteroskedasticity,  we  propose  a  general  random  coef- 
ficient disturbance  process  in  which  the  AR,  ARCH  and  GARCH  processes  are  obtained 
as  special  cases.  We  develop  a  new  procedure  for  deriving  the  stationarity  conditions  for 
our  general  disturbance  process  through  the  vector  representation  of  the  model  and  discuss 
the  interaction  between  autocorrelation  and  conditional  hateroskedasticity.  Also  we  show 
that  the  stationarity  conditions  for  the  GARCH  model  can  be  obtained  in  a  much  more 
easier  way.  Test  statistics  for  conditional  heteroskedasticity  in  the  presence  of  autocorre- 
lation and  vice  versa  when  the  lagged  dependent  variables  are  included  as  regressors  are 
proposed.  Through  an  illustrative  example  of  estimating  the  variability  of  inflation,  we 
show  how  misspecifying  the  conditional  heteroskedasticity  or  neglecting  the  autocorrela- 
tion process  might  affect  the  inferences  on  the  conditional  second  moments  of  a  random 
variable. 


1.  INTRODUCTION 

As  the  autoregressive  conditional  heteroskedasticity  (ARCH)  model  introduced  by 
Engle  (1982)  has  emerged  as  an  important  innovation  for  modeling  the  second  moment  of 
a  random  variable  conditional  on  the  information  set,  there  has  been  increasing  concern 
over  the  formulation  of  conditional  variance  function.  In  particular,  the  generalized  au- 
toregressive conditional  heteroskedasticity  (GARCH)  model  proposed  by  Bollerslev  (1986) 
is  regarded  as  an  interesting  extension  of  Engle's  ARCH  model  from  practical  and  the- 
oretical points  of  view.  The  GARCH  specification  is  characterized  by  the  inclusion  of 
lagged  conditional  variances  along  with  lagged  squared  error  terms  in  the  conditional  vari- 
ance formulation. The  extension  of  the  ARCH  process  to  the  GARCH  process  reveals 
much  similarity  to  the  extension  of  the  MA  process  to  the  ARM  A  process  in  time  se- 
ries analysis.  As  a  higher-order  MA  process  can  be  always  approximated  by  a  stationary 
lower-order  ARM  A  process,  Bollerslev  (1986)  showed  that  a  lower-order  GARCH  process 
may  be  viewed  as  an  approximation  of  higher-order  ARCH  process.  What  renders  the 
GARCH  specification  more  attractive  is  that  it  might  allow  for  a  longer  memory  and 
a  smoother  lag  strucutre.  Furthermore,  the  presence  of  the  GARCH  process  has  been 
observed  in  many  empirical  applications  [see,  for  example,  Bollerslev  (1986,  1987),  Baillie 
and  Bollerslev  (1987),  McCurdy  and  Morgan  (1988),  Bollerslev,  Engle  and  Wooldridge 
(1988)  and  Chou  (1988)]. 

Recently,  Bera  and  Lee  (1988a)  established  a  close  connection  among  three  concepts: 
the  information  matrix  test,  parameter  heterogeneity  and  ARCH,  and  provided  a  random 
coefficient  interpretation  of  the  ARCH  model.  This  result  is  an  interesting  rationale  for 
using  the  ARCH  type  models  as  a  form  of  conditional  heteroskedasticity.  Following  these 
findings,  Bera  and  Lee  (1988b)  proposed  a  random  coefficient  autoregressive  error  process 
for  conditional  heteroskedasticity.  The  purpose  of  this  paper  is  to  provide  a  unified  random 
coefficient  approach  to  explore  the  stationarity  conditions  and  the  test  statistics  for  various 
specifications  of  error  processes  in  a  linear  regression  model  containing  lagged  dependent 
variables  with  a  general  structure  for  conditional  heteroskedasticity. 


In  order  to  analyze  various  disturbance  processes  characterized  by  the  first  and  second 
moments  in  a  unified  framework,  in  section  2,  we  propose  a  general  random  coefficient  dis- 
turbance process  in  which  the  AR,  ARCH  and  GARCH  processes  are  obtained  as  special 
cases.  In  Bera  and  Lee  (1988b),  the  theorem,  suggested  by  Andel  (1976)  and  Nicholls 
(1986),  which  states  the  second-order  stationarity  conditions  for  the  random  coefficient 
autoregressive  process  in  time  series  analysis  was  used  for  deriving  the  stationarity  condi- 
tions for  the  ARCH  type  specification  in  the  presence  of  autocorrelation  and  for  discussing 
their  interaction.  However,  the  stationarity  conditions  for  our  general  error  process  cannot 
be  obtained  from  this  theorem.  For  handling  this  problem,  in  section  3,  we  represent  our 
general  disturbance  process  in  a  vector  form.  Using  this  vector  representation,  we  develop 
a  new  procedure  for  deriving  the  stationarity  conditions  for  our  general  error  process  and 
discuss  the  interaction  between  autocorrelation  and  the  GARCH  through  some  examples. 
In  section  4,  we  take  up  the  testing  problems  and  derive  the  test  statistics  for  various 
specifications  of  conditional  heteroskedasticity  in  the  presence  of  autocorrelation  and  vice 
versa,  using  the  Lagrange  multiplier  (LM)  test  principle.  Next  in  section  5,  we  rework 
the  Engle  (1983)  specification  of  the  model  for  variability  of  inflation  in  the  light  of  our 
theoretical  development  of  earlier  sections.  Lastly,  some  concluding  remarks  are  offered  in 
the  last  section. 

2.  A  GENERAL  MODEL  FOR  CONDITIONAL  HETEROSKEDASTICITY 

In  this  section,  we  begin  by  proposing  a  general  structure  for  conditional  heteroskedas- 
ticity in  a  random  coefficient  framework.  Then  we  show  that  this  model  encompasses,  as 
special  cases,  various  ARCH  type  models  and  also  provides  a  convenient  framework  to  in- 
vestigate the  interrelationship  between  autocorrelation  and  conditional  heteroskedasticity. 

Let  et  be  a  real  valued  stochastic  process  in  equidistant  discrete  time  t  £  T ,  and  let 
^t-i  denote  tne  information  set  available  at  time  t.  It  is  assumed  that  the  distribution  of 
et  conditional  on  ^t_  i  is  normal  with  mean  nt  =  E{et  |  #t_  t)  and  variance  kt  =  Var(et  | 
^t-i),  and  that  the  stochatic  process  of  et  is  evolutionary  with  random  coefficients.    A 


general  linear  regression  model  with  this  kind  of  error  structure  is  then  specified  by 

yt=x't(5  +  Et  (2.1) 

gt  =  y^  <t>it£t-  i + 52 a^  >a*-.>  +  Ut 

i=i  y=i 

p  <? 

=  Z)(&  +  »?«)*«-*  +  52  <*jt  \Aw  +  "t  (2.2) 

;=i  y=i 

where  yt  is  a  dependent  variable,  xt  is  a  vector  of  exogenous  and  lagged  dependent  vari- 
ables, 0  and  <}>i  are  unknown  constant  parameters,  rjit  and  aJt  are  random  coefficients. 
One  interesting  feature  of  our  general  random  coefficient  error  process  (2.2)  is  that  it  in- 
cludes square  roots  of  lagged  conditional  variances  along  with  lagged  errors  as  independent 
variables.  This  implies  that  the  current  error  is  assumed  to  be  explained  by  the  past  errors 
and  their  conditional  standard  deviations. 

To  proceed  further,  the  following  assumptions  are  required. 

ASSUMPTIONS,  (i)  rjt  =  (tju,-  •■  ,r)pt)'  is  a  sequence  of  identically  and  independently  dis- 
tributed random  vectors  with  E(rjt)  =  0px  j  and  E(r]tr)'t)  =  Ep,  where  £p  is  a  pxp  positive 
semideBnite  matrix  not  depending  on  t.  (ii)ctt  =  (a„,  •  •  • ,  ctqt)'  is  a  squence  of  identically 
and  independently  distributed  random  vectors  with  E(ctt)  =  0,xl  and  E(ctta't)  =  Aq, 
where  A,  is  a  q  x  q  positive  semidefinite  matrix  not  depending  on  t.  (Hi)  ut  is  a  se- 
quence of  identically  and  independently  distributed  random  variables  with  E(ut)  =  0  and 
E[u2t)  =  ol,  and  (iv)  rjt,  6t  and  ut  are  mutually  independent. 

Under  the  above  assumptions,  the  conditional  mean  and  variance  of  the  disturbance 
process  et  can  be  represented  as 

fit  =  <f>'£j_  (2.3) 

ht  =  ee.'Ep^  +  v/C  A,  \fht_  +  o\  (2.4) 

where  <j>  =  (<f>lt.  •  •  ,<£„)',  e,  =  [et_u  ■  •  •  ,e,_p)'  and  V^  =  (V^t-i,  •  ■  • ,  \At-J'-  Equa- 
tions  (2.3)   and  (2.4)   describe  autocorrelation  and  a  general  form  of  conditional  het- 


eroskedasticity,  respectively.  For  analytical  convenience,  it  is  assumed  that  A,  is  a  di- 
agonal matrix,  say  A,  =  diag(61  ,  •  •  •  ,6q).  This  implies  that  only  the  past  conditional 
variances  are  included  in  the  current  conditional  variance  function.  These  terms  reflect 
some  sort  of  adaptive  learning  mechanism  in  the  formulation  of  the  second  moment  of  the 
disturbance  term  et.  As  Bollerslev  (1986)  pointed  out,  the  inclusion  of  a  learning  mech- 
anism in  the  conditional  variance  function  allows  for  both  a  longer  memory  and  a  more 
flexible  lag  structure.  Under  the  assumption  of  A,  =  0qxq,  the  statistical  properties  of  the 
error  process  described  by  equations  (2.3)  and  (2.4)  have  been  discussed  in  Bera  and  Lee 
(1988b)  where  it  was  called  the  augmented  autoregressive  conditional  heteroskedasticity 
(AARCH )  process.  Engle's  (1982)  ARCH  process  is  obtained  as  a  special  case  of  AARCH 
when  Ep  is  diagonal.  We  will  refer  to  a  model  with  conditional  variance  function  speci- 
fied by  the  non-diagonality  of  Ep  and  the  diagonality  of  A,  as  the  generalized  augmented 
autoregressive  conditional  heteroskedasticity,  in  short  GAARCH(q,p),  to  differentiate  it 
from  Bollerslev's  (1986)  GARCH{q,p)  which  is  obtained  when  Ep  and  A,  are  diagonal. 
Table  1  summarizes  different  disturbance  processes  which  are  obtained  by  imposing  certain 
restrictions  on  <£,  E,  and  A,. 

3.  CONDITIONS  FOR  ASYMPTOTIC  STATIONARITY 

3.1  A  Vector  Representation  of  the  Disturbance  Process 

It  is  well  known  in  time  series  literature  that  it  is  convenient  to  study  the  properties  of  a 
stochastic  process  when  the  model  can  be  written  in  the  form  of  a  vector  difference  equation 
so  that  the  Markovian  nature  of  the  model  could  be  exploited  [see,  for  example,  Anderson 
(1971),  Akaike  (1974),  Priestley  (1978),  Rao  (1981),  Ray  (1983)  and  Liu  (1985)].  Following 
this  approach,  we  represent  the  process  (2.2)  in  a  vector  form.  Here  we  should  note  that  the 
process  (2.2)  is  quite  flexible  in  that  the  order  of  autocorrelation  can  be  selected  differently 
from  that  of  AARCH  or  ARCH  and  that  of  lagged  conditional  variances.  To  emphasize 
this  point,  let  s  =  max(r,p,  q),  where  r  is  the  order  of  autocorrelation  and  define  arxl 


vector  4>*  =  [4>i ,  •  •  •  ,<f>r)' .  In  order  to  represent  the  disturbance  process  in  a  vector  form  , 
we  define  the  following  s  x  s  matrices. 


$  = 


r<  = 


4>'  Olx(.-r-l)  OlXl 

h  Or  X  {*  -  r-  1)  Or  x  1 

_0(»-r-l)xr  L-r-l  0(  «  -  r  -  1 )  X  1  . 

n't  olx(,_p) 

0(,-p)xp  0(.-l)x(«-p)  J 

a't  °ix(.-«) 

0(»-l)x«  0(»-l)x(»- 


)x  («-<?)  J  , 


Then  the  process  (2.2)  can  be  represented,  in  a  vector  form,  as 


&  =  [*  +  3t]6-i  +rt/ct_x  +vt 


(3.1) 


where  &  =  (et,et-i,- ••,et_4+1),J  «*_!  =  (v^I7,  v7i(-2,  ■  ■  ■ ,  \fK- .)'  and  ut  =  (ut,0,- ••  ,0)' 
are  s  x  1  vectors. 


3.2.  Second-Order  Stationarity  Conditions 

In  order  to  examine  the  conditions  for  second-order  stationarity,  we  define  Vt    = 
E(£t£'t).  Then,  we  can  write  Vt  as 

vt  =  e[{{$  +  a.)6-i  +rt«,-,  +^}{(*  +  at)e»-i  +rtKt_1  +«,}'] 
»^[(«  +  B,)€i-iS.x(*  +  3,)'  +  rficf-1ic;.1rt  +  wlt<] 

=  ^(^6-1e;_1^)  +  ^(Hf6-1e;_15;)  +  £;(rt/ct_1/c;_1rt)  +  ^G        (3.2) 


where  G  is  a  5  x  s  matrix  defined  as 


1  Olx(.-l) 

0(«-l)xl       0(«-i)x(.-i) 


For  simplifying  the  expression  of  equation  (3.2),  we  define  Kt-i  =  E(Kt.  x  k[_  , ), 
E,  =  E{rjt,T)'tt)  and  A,  =  E{atta'tt),  where  r?t,  =  [r]lt,  •  •  •  ,r)pt  ,0,  •  •  •  ,0)'  and  at,  = 
(alt,  •  •  •  ,a,t,0,  •  •  •  ,0)'  are  5Xl  vectors.  To  find  E(Et  £t-i  Ct-  i~'t)>  first  note  that 

V't^^t^t         Oix(.-p) 


Taking  expectation  of  the  first  element,  we  have 


°(*-l)xp       °(.-l)x(.-p)  J,x, 


EfoEt^Vt)  =  E[E{ri't^rit  \  Vt_x)\ 

=  JE?[tr{(6_le_i)^h..1.'.)}] 
=  ir(Vt_1S.) 

Therefore  ^(5t6-ie;_15;)=^(v/t-iEjG.Similarly^(rt/ct_1/c;_ir'J  =  {tr(^_1A,)}G. 
Now  noting  that  for  suitably  dimensioned  matrices  A  and  B,  tr{AB)  =  vec(A')'vec(B)  = 
vec(B')'vec(A)  [see,  for  example,  Dhrymes  (1978,  p. 521)],  we  rewrite  equation  (3.2)  as 

Vt  =  $Vt_1$'  +  {ir(V1_1E,)}G  +  {rr(^_1A.)}G  +  ^G 

=  $7,.!$'  +(vecE,)'(t;ecVt_1)G  +  (i;ecA,)'(vecJCt_1)G  +  ^G  (3.3) 

Using  the  result  that  vec(A1A-2 A3)  =  (j4'3  <g>  Al)vec{A2)  for  appropriately  dimensioned 
matrices  Ax ,  -A2  and  -^3  matrices  [see,  for  example,  Dhrymes  (1978,  p. 519)],  equation  (3.3) 
can  be  expressed  as 

vec(Vt)  =  [($  ®  $)  +  (uecG)(uecE.)']uec(Vt_1)  +  (vecG)(vecA.)'vec(/Ct_  , )  +«7juccG 

(3.4) 
Now  equation  (3.4)  can  be  used  to  find  the  second-order  stationarity  conditions  as 
stated  in  the  following  proposition. 

PROPOSITION  1.  It  is  assumed  that  A.  =  diag(6l,---,6q,0,---  ,0)  is  a  5  x  5  positive 
semidefinite  diagonal  matrix.  Let  <f>,  =  (<£i ,  •  •  • ,  4>T ,  0,  •  •  • ,  0)'  and  define  s  x  s  matrices  #, , 


:'  =  1,2,  •••,9,  as 

R,  =  [($®$)  +  (vecG)(vecE,)'  +  {vecG)(vecA.)'  -  Si  (vecG)(vec[<f>4<t>'t))']      and 
Ri  =  -Si  {vecG)(vec(<f>,<f>'.))\         i  =  2,  •  •  •  ,q 

Then  the  series  et  specified  by  equation  (3.1)  is  second-order  stationary  if  and  only  if  all 
the  roots  of  the  characteristic  equation 

|  XqI,  -X'-'R,  -\q-2R? R„  |=0 

are  less  than  one  in  abosolute  value,  where  A  £  R1 . 

PROOF:    First,  we  try  to  simplify  the  second  term  of  the  left  hand  side  of  equation  (3.4). 
Under  the  assumption  that  A,  =  (Sx , •  •  •  ,Sq, 0, •  •  •  ,0),  we  can  show  that 

{vecG){vecA,)'{vecKt_1)  =  (vecG)(*T  £/£(&«-,-),  0,  •  •  •  ,0)'  (3.5) 

To  simplify  equation  (3.5),  note  that 

E(ht.i)  =  E[Var(et.J -|  ¥,-,■- J] 

=  E  [E(sl:  |  ^t_j.1)  -  {E(et.,.  |  Vw-x)}*] 
=  E(e2t_.)-<f>'.Vt_f<f>.. 

And  hence 

{vecG){vecA,)'{vecKt.l)  =  (vecG)(vecA.)'(t;ecVc_  x)  -  (vecG)  ]££,•#  K-ytf, 

3=1 

=  (vecG)  (vec A. )'  (vecV,  _  , )  -  (vecG)  £  S,- 1 r( V,  _ ,  ^  # ) 

=  (vecG)(vec&,)'{vecVt^)  -  ^*y(i;ecG)(vec(^^))'(t;ecV;_y) 


y=i 


Substituting  this  result  into  equation  (3.4),  we  obtain 

vec{Vt)  =  [($$$)  +  {vecG){vecZ,)'\vec{Vt_l)  +  {vecG)(vecA.)'(vecVt_l) 
i 
-  ^26j{vecG){vec{<}>.4>'t)' (vecVt_  j)  +  o\vtcG 

=  Rxvtc{yt_^  +  R2vec(Vt.2)  +  •••  +  Rqvec{Vt.q)  +  a\vecG  (3.6) 

This  is  the  gth-order  difference  equation  in  vec(Vt).   Therefore,  vec(Vt)  converges  if  and 
only  if  all  the  roots  of  the  characteristic  equation 


\qI,  -X'-'R,  -Xq~2R, 


R,  \=o 


(3.7) 


are  less  than  one.  Q.E.D. 

If  the  conditions  for  second-order  stationarity  stated  in  Proposition  1  are  satisfied, 
the  asymptotic  value  of  Vt,  say  V,  is 


vec{V)  =  c\ 


h®h -i^ 


t=  i 


- 1 


vecG 


(3.8) 


The  second-order  stationarity  conditions  stated  in  Proposition  1  is  quite  general.  It 
covers  a  wide  class  of  ARCH  type  processes,  autocorrelation  processes  and  their  combi- 
nations. We  consider  some  interesting  special  cases  below. 

CASE  1:  (AR)  It  is  assumed  that  there  is  no  conditional  heteroskedasticity,  i.e. 
£.  =  0<x,  and  A,  =  O,*,.  For  this  case,  equation  (3.4)  reduces  to  vec(Vt)  =  [$  <g> 
$\vec(Vt_  l)  -f  a\G.  Therefore,  an  AR(r)  process  is  second-order  stationary  if  and  only  if 
all  the  eigenvalues  of  the  matrix  By  =  [$  <g)  $]  are  less  than  one  in  absolute  value.  This 
condition  is  equivalent  to  the  traditional  stationarity  conditions  for  the  AR(r)  process 
which  is  described  by  the  matrix 


M  = 


4>'-  T  <f>r 

It -I  0(  r  -  1  )  X  1 
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where  <£_  r  =  {<f>x  >  •  *  *  j  4>r-i)'  is  a  (r  —  1)  X  1  vector.  For  showing  this  point  more  explicitly, 
we  note  that  the  characteristic  equation  for  the  matrix  M  is  exactly  the  same  as  that  for 
the  matrix  $.  Let  (Ai,«",A,)  be  the  eigenvalues  of  $  and  define  A  =  diag(X1 ,  •  •  • ,  A,). 
Then  it  can  be  shown  that  A  <g)  A  is  the  matrix  of  eigenvalues  of  $  ®  $.  Obviously,  it 
follows  that  any  eigenvalue  of  $  <g>  $  takes  the  form  of  A,  Ay ,  for  t,  j  =  1, 2,  •  •  • ,  s,  and  hence 
|  AtAy  |<  1  iff  both  |  Xi  |  and  |  Ay  |  are  less  than  one.  Therefore,  the  two  conditions  are 
equivalent. 

CASE  2:  (AARCH  and  ARCH)  It  is  assumed  that  <f>,  =0,xl  and  A,  =  0,x,.  Let 


$*  = 


^lx(i-l)  "l  X  1 

I»-  1  0(«  -  1)X  1 


Then  the  AARCH(p)  (ARCH(p)  if  £,  is  diagonal)  process  is  second-order  stationary  if 
and  only  if  all  the  eigenvalues  of  the  matrix  B2  =  [($'  ®  $*)  +  (vecG)(vecT,t)'}  are  less 
than  one  in  absolute  value. 

CASE  3:  (G AARCH  and  GARCH)  The  GAARCH{q,p)  {GARCH{q,p)  if  E.  is 
diagonal)  process  is  second-order  stationary  if  and  only  if  all  the  eigenvalues  of  the  matrix 
B3  =  [(<£*  <g>  $*)  +  {vecG){vecYit)'  +  (vecG)(vecA,)'}  are  less  than  one  in  absolute  value. 

In  our  framework,  the  stationarity  conditions  for  ARCH(p)  and  GARCH(q,p)  pro- 
cesses can  be  derived  in  an  easier  way  than  those  suggested  by  Engle  (1982)  and  Bollerslev 
(1986).  To  show  this,  we  introduce  a  theorem  for  bounding  the  eigenvalues  of  an  arbitrary 

matrix. 

THEOREM  1.  (Gerschgorin):  Let  A  =  [atJ]  be  a  matrix  of  order  s  and  let  A  be  an 
eigenvalue  of  A.  Define  g{  =  Y^'-^i  I  a»y  l»  *  =  1>2,  •  •  •  ,s,  and  let  Z{  denote  a  circle  in  the 
complex  plane  C  with  center  a,,-  and  radius  g{,  i.e.  Zi  =  {z  G  C  ||  z  —  a{i  \<  g{}.  Then  A 
belongs  to  one  of  the  circles  Z, . 

We  refer  to  Atkinson  (1978,  pp.500-502)  for  the  proof  of  Theorem  1.  This  theorem 
implies  that  the  abosolute  value  of  an  eigenvalue  of  A  is  bounded  by  the  summation  of 
absolute  values  of  all  elements  in  a  row.  Note  that  this  result  holds  for  the  columns  of  A 


since  A  and  A'  have  the  same  eigenvalues  and  characteristic  polynomial.  We  now  can  obtain 
the  stationarity  conditions  for  ARCH(p)  and  GARCH(q,p)  by  applying  the  Gerschgorin 
theorem  to  the  matrices  B2  and  B3 ,  and  making  the  upper  bound  of  their  eigenvalues  be 
less  than  one.  Given  the  structure  of  the  matrix  G  in  B2  and  B3,  it  is  enough  to  consider 
only  their  first  rows.  Then  for  cases  2  and  3,  it  follows  that  the  sufficient  conditions  for 
stationarity  are  given  by  ^=1  7«  <  1  f°r  ARCH(p)  process  and  Y^=i  It  +  Hy=i  fy  <  1 
for  GARCH(q,p)  process,  respectively. 

So  far,  we  showed  how  the  second-order  stationarity  conditions  for  various  conditional 
heteroskedasticity  processes  can  be  easily  checked  in  our  unified  framework.  Before  closing 
this  section,  we  suggest  a  practical  method  for  checking  the  stationarity  conditions  and 
consider  some  simple  examples  to  illustrate  the  interaction  between  autocorrelation  and 
conditional  heteroskedasticity.  For  practical  purpose,  we  may  use  the  following  Schur 
theorem  in  order  to  check  the  necessary  and  sufficient  conditions  for  stationarity. 

THEOREM  2.    (Schur):  All  the  roots  of  the  nth-degree  polynomial  equation 

Oq zn  +  a^zn~x  + h  an _  t z  +  an  —  0 

are  less  than  one  in  absolute  value  if  and  only  if  the  following  n  determinants, 


Dk  = 


Oq 

0 

..          0 

an 

an-i      • 

•  •     an-k+i 

<*1 

Oo 

..           0 

0 

an 

O-n  -  k  +  2 

I 

• 

'. 

I 

• 

'. 

O-k-l 

a-k-2 

..        Oo 

0 

0 

an 

0>n 

0 

..      0 

Oo 

ai 

O-k-l 

O.n-1 

fl» 

..      0 

0 

a0 

a-k-i 

• 

'. 

'. 

• 

'. 

\ 

»n-fc+l 

an  -  k  +  2 

••     an 

0 

0 

Oo 

of  dimension  (2k  x  2k),  k  =  1,2,  •  •  • ,  n,  are  ai/  positive. 

We  refer  to  Chipman  (1951,  pp. 119-120)  for  a  detailed  discussion  of  the  Schur  theorem 
[see  also  Chiang  (1984,  pp.601-603)].  The  application  of  this  theorem  is  quite  straightfor- 
ward because  the  characteristic  equation  (3.7)  will  be  a  polynomial  of  degree  of  at  most 
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q.  Also  in  our  context,  many  matrices  are  sparce  and  we  always  have  Oq  =  1.  As  an 
illustration,  we  consider  the  case  of  a  G ARCH (2,  l)  process  combined  with  AR(l).  In  this 
case,  we  identify  the  relevant  matrices  for  Ri  and  R?  as 


$  = 


4>x 
l 


,G  = 


1     0 
0     0 


,£. 


7i     0 
0      0 


A.  = 


0 


0 

<$2 


and  4>,  =  (</>!,  0,0,0)'.  Therefore,  the  characteristic  equation  |  A2  -  \RX  -  R^  \—  0  reduces 
to 

A2  -  A[#  +  7i  +  h (1  "  <t>\)\  ~  6* (1  "  4i)  =  0 

Applying  the  Schur  theorem,  we  obtain 


A  = 


do      <h 


=  l-ai 


and 


D*  = 


Oo 

0 

Ch 

d 

ai 

ao 

0 

<h 

0 

Oo 

o-i 

a, 

(h 

0 

<h 

=  (<h~  I)2  [(<h  +al+l)(a2-al+  1)] 


where  at  =  -[<£2  +  7L  +  Sl(l  —  4>\)\  and  a^  =  — <52(1  —  <£2).  Now  note  that  from  the 
regularity  conditions  [0  <  62  <  1,  0  <  4>\  <  l]  Dx  is  always  positive.  Also  for  D2,  noting 
that  04  —  ax  +  1  >  0*2  +  ax  +  1,  all  we  need  is  to  find  the  sufficient  condition  for  a?  +  ax  +  1 
to  be  positive.  It  is  easy  to  see  that  the  required  condition  is  ■  7'  3  +  <5X  +  <52  <  1. 

Table  2  summarizes  the  stationarity  conditions  for  some  simple  cases  illustrating  the 
interrelationship  between  autocorrelation  and  conditional  heteroskedasticity.  To  show  the 
influence  of  autocorrelation,  let  us  consider  a  simple  example.  In  the  absence  of  autocor- 
relation, the  stationarity  condition  for  a  GARCH(l,  1)  process  is  71  +  <$i  <  1.  However,  if 
AR(l)  with  4>x  =  0.5  is  present,  the  stationaity  condition  changes  to  0.757i  +  6X  <  1.  As 
illustrated  in  Figure  1,  the  stationarity  region  for  (71,61)  shrinks  from  AOLM  to  AOLN. 
Clearly,  this  example  shows  that  the  presence  of  autocorrelation  can  make  a  stationary 
conditional  heteroskedasticity  process  nonstationary. 
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4.  THE  TEST  STATISTICS 
4.1  The  Likelihood  Function  and  the  Information  Matrix 

Before  proceeding  to  explore  the  problem  of  testing  various  specifications  of  the  first 
and  second  moments  of  the  error  term  in  a  regression  model,  a  brief  discussion  on  the 
properties  of  the  likelihood  function  and  the  Fisher's  information  matrix  is  provided  in 
this  section.  We  need  these  results  to  derive  the  specification  tests  for  autocorrelation  and 
conditional  heteroskedasticity  in  the  next  section. 

We  define  7  =  vec/i(Ep)  and  6  =  (<5X ,  •  •  •  ,  <$, )'  in  order  to  consider  only  the  distinct 
elements  of  Ep  and  A,,  and  express  the  conditional  variance  function  h^  in  terms  of  7  and 
6  as 

ht=ol+1Zt+6'Wt  (4.1) 

where  Zt  —  Kpvec{etet')  and  Wt  =  (/it_  : ,  •  ••  ,/it_,)'.  Note  that  Kp  is  a  selection  matrix 
such  that  for  a  matrix  A,  vech(A)  =  Kpvec(A),  where  veck(A)  is  a  column  vector  obtained 
by  stacking  the  elements  of  the  lower  triangle  of  A.  Let  6  =  ((3' ,  <f>' ,  7' ,  6' ,  o2n )'  be  the  vector 
of  all  parameters  in  the  model.  If  it  is  assumed  that  the  distribution  of  the  disturbance 
term  et  conditional  on  the  information  set  ^t-  1  is  normal,  then  the  log-likelihood  function 
lN  (9)  for  the  model  (2.1)  and  (2.2)  is  given  by 

1    -  1    "     1 

/„  (0)  =  const  -  -X>(At)  --J2  jrv"  (4-2) 

1=1  t=  1 

where  vt  =  et—  <f>' e^.  Note  that  vt  is  a  function  of  0  and  <f>,  i.e.  vt  =  (yt  —  4>'yt )  —  (xt  —  0'xjj'/?, 
where  y^  =  (yt_  x ,  •  •  •  ,yt_r)'  and  x±  =  (it_  x ,  •  •  •  ,xt_r)'. 

To  make  our  discussion  simpler,  we  partition  6  into  the  mean  parameter  vector  6X 
and  the  variance  parameter  vector  02,  i-e.    6  =  (^,^2)'  where  9X    =  (/?',</>')'  and  62   = 
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(i\6'*°iy> Then  we  have 


dlN(B)  ^  1       ( dvt\   .   1  ^       fdht 


t=  i 


f^  1       fdvt\       1^1 


30, 

gjg  (g) 
d02        "  2  *-i  ht  \dt 

d2lN  (0) 


ht      \d$1 

1^   1    ( dht 


2  ^  h^  Xdd, 

t=  i 


l- 


t=  i 

N 


t-1 


ae.dd^ 


*  =  -£ 


t=  i 

N        r 


ht  \d$J  \d9j 


mv* 


sej  \dej 


+ 


^E 


d2lN(0) 


t=  i 

AT 


dht 


1  d/i, 


/it  V^i7  ^  V^t      /     v^t      /  ^i  V^t  do, 


dd2d6 


2        2  <tt  *« 


d02d02 


9  Z-^  h2 


dht  \  ( dht 


t=  i 


&lN  (6) 

dd 


1    N 

E 


<902, 

a 


dd. 


2v? 


t=  i 


1     H_! 

ht   \ht 


d2ht 


d$2  \ht         J 
\   I  dht  \   (  dht  \ 


h\  \ht 


dd, 


dd. 


Here  we  should  note  that  the  first  partial  derivatives  of  conditional  variance  function 
ht  with  respect  to  6,  and  62  include  the  recursive  part  as  shown  below 


dht         ,  (  dZt 

=  1   ' 


dd, 


dd 


9 +!>(%*)  -  £-*+5>(^ 

j  =  i  y  =  i 


where  Et  =  (1,  Z't, W't)'  is  a  [l  +  *i£±!l  +  g 


X  1  vector.  These  recursive  parts  appear  from 
the  inclusion  of  lagged  conditional  variances  in  the  specification  of  conditional  variance 
function  ht. 

Now  we  show  that  in  our  case,  the  Fisher's  information  matrix  I{6),  defined  as 


-E 


aeae' 


,  exhibits  the  block-diagonality  between  the  mean  parameters  and  the  vari- 


ance parameters. 
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PROPOSITION  2.  For  a  linear  regression  model  yt  =x[P  +  et  with  the  disturbance  process 
specified  by  equations  (2.3)  and  (4.1),  the  Fisher's  information  matrix  is  block  diagonal 
between  the  mean  parameters  8y  and  the  variance  parameters  62. 

PROOF:  After  taking  conditional  expectations  iteratively,  we  can  express  the  off-diagonal 
block  of  the  information  matrix,  denoted  by  h1e.1 ,  as 


dhA' 


J»l»a  =  ~E 

_d6ld6'2j 

N 

=  -!> 

t=  i 

"  1       (dvt 

Since  E(vt  |  ^t-i)  =  0>  we  have 

N 

^1»J    =   ~  /   ,E 

t=  1 

1    (dvt 

)(S)^'H 

=  0. 


Q.E.D. 


Furthermore,  since  E(vt   |  ^t-i)  —  0  and  E(v*  |  ^t_i)  =  ht,  the  diagonal-blocks  of  the 
information  matrix,  say  I0l  and  I0l ,  can  be  simplified  as 


/.,= 

-£ 

_d6lde,l 

'•■  = 

-£ 

'd2iN{ey 

d62d0'2 

N 


t=  i 


]_/dvA 
h,  \d6j 

e 

1  dht 


t  =  i 


1  dht 


ht  d62      \ht  dO* 


Note  that  these  involve  only  the  first  partial  derivatives.  The  above  results  will  be  used  in 
the  following  sections  to  derive  the  different  LM  test  statistics. 

4.2  LM  Tests  for  Conditional  Heteroskedasticity  in  the  Presence  of  Autocorrelation 

In  this  section,  we  derive  the  LM  tests  for  various  specifications  of  conditional  het- 
eroskedasticity. First  we  attempt  to  develope  a  general  testing  procedure  for  conditional 
heteroskedasticity.  As  in  Engle  and  Kraft  (1983)  and  Bollerslev  (1986),  we  partition  the 
conditional  variance  function  (4.1)  as 


ht  =  u>[  Elt  +  u'2  E2t 


(4.3) 
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where  ux  and  u2  are  parameter  vectors  defined  appropriately  from  62,  and  Eit  and  E2t 
are  defined  from  Et  =  {\,Z[,Wl)'  corresponding  to  u^  and  u>2.  Then  it  can  be  seen  that, 
for  i  =  1,2, 


dls  W 

dijJi 


lfiW       if  i2/^_ 
2L,K  \dujJ  +  2^hlVt  {dui 


i    N 

=  £ 


t=  i 


s- 


1  <9M 
/it  do;,-  / 


(4.4) 


Since  the  Fisher's  information  matrix  in  our  case  is  block  diagonal  between  0X  and  02,  it 
is  enough  to  consider  I0i  part  only  for  deriving  the  LM  tests.  Expressing  Ig7  as  a  matrix 
for  (u>! ,  w2 ) ,  we  have 


^     =    o^ 


1     dh, 
h  ,    d  w  i 


(4.5) 


/   1     dht  \    f   1     dht  \  (   1     3ht  \    /   1     3/tt  \ 

Vh.f   9uj  y    V  /it   du/i  y  \'l«   3wj  y    V  ht  du,  y 

The  LM  test  is  based  on  the  score  vector  and  its  variance-covariance  matrix  under  the 
null  hypothesis.  We  now  consider  the  testing  problem  for  the  null  hypothesis  H0  :  u2  =  0. 
From  the  estimation  of  the  model  under  the  null  hypothesis,  we  obtain  the  quantities 
i t  =  yt  —  xt(3,  0t  =  it  —  4>'£t_  and  ht  =  &[ZU,  where  the  hat  indicates  that  the  quantities 
have  been  evaluated  at  the  restricted  MLE  obtained  under  the  null  hypothesis.     Let 

ft  =  j£  -  1  and  /  =  (/i, ••-,/*)'•  Also  define  At  =  r(^)  for  *  =  1'2,  and  let 
Pi  =  [Pn,-~,PiH)'  and  M(A)  =  J-  AtA'A)-1^',  for  t'  =  1,2.  Then  we  have  the 
following  result. 

PROPOSITION  3.  The  LM  statistic  for  testing  H0  :  u>2  =  0  in  the  presence  of  autocorre- 
lation, denoted  as  LMUJ\AR  ,  is  one  half  of  the  explained  sum  of  squares  from  the  ordinary 
least  squares  (OLS)  regression  of  f  on  M(Pl)P2. 

PROOF:    The  LM  test  for  the  null  hypothesis  is  constructed  as 


IMU 


\AR 


dls  (g) 

d(jj2 


Var 


dlN  (0) 


(dls( 


(«) 
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Under  the  null  hypothesis,  the  score  vector  for  w2  is  given  by 

ag£))  =  |M 

ObJ2     J         2 

Using  the  inversion  formula  of  the  partitioned  matrix,  we  write  the  variance-convariance 
matrix  for  the  score  vector  for  w2  as 


Var 


dls  (0) 
doj2 


1      *  •  1      A  »  /l      «  -      \"*       1      .  * 


-  1 


=  2 
=  2 


AA-AAcA'Ar'A'A1 


P^M{P1)P2 


- 1 


Therefore, 


1 


^M.,,^  =  2/,P2    P^(A)P2 


- 1   ^ 


^/  (4-6) 

and  since  /'Pj,  =0  and  hence  f'M(P1)  =  /',  the  LM  statistic  can  be  rewritten  as 

(4.7) 

This  completes  the  proof.  Q.E.D. 


LMUi]AR  =  i/'M(A)A  [A'M(A)A]_1  ^Af(A)/ 


Under  #0,  LMUi\AR  follows  asymptotically  a  x2  distribution  with  ^  degrees  of  free- 
dom, where  v  is  the  number  of  restriction  imposed  by  the  null  hypothesis.  Since  M(P1)f  = 
f  and  plim  (  f-^-  j  =  2  under  the  conditional  normality  assumption,  a  statistic  which  is 
asymptotically  equivalent  to  LMWi\AR  can  be  expressed  as 


lm:^ar 


/'m(A)A[Aa*(A)A1  x  P^M(Pl)f 

N l- : J =  7VP2 


f'M(Px)f 


(4.8) 


where  R2  is  the  coefficient  of  determination  from  the  OLS  regression  of  M(Pi)/  on 
M{PX)P2.  For  practical  convenience,  this  R2  can  be  easily  obtained  from  the  OLS  re- 
gression of  /  on  (P1,P2).  If  there  is  no  autocorrelation,  we  replace  vt  in  ft  by  it. 
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From  the  above  result,  it  is  easy  to  derive  some  interesting  special  cases.  For  example, 
suppose  that  it  has  been  concluded  that  ARCH  (AARCH)  is  present,  and  now  it  is  of 
interest  to  test  whether  the  lagged  conditional  variances  can  be  included  for  a  parsimonious 
representation  of  conditional  variance  function.  In  our  framework,  this  is  equivalent  to 
testing  the  null  hypothesis  H0  :  6  =  0,  and  therefore  we  set  u>2  =  6.  From  the  uNR2n 
interpretation  of  the  LM  test,  the  LM  statistic  for  H0  :  6  =  0  is  easily  calculated  as  NR2 , 
where  R2  is  the  coefficient  of  determination  from  the  OLS  regression  of  ft  on  (Pn>-p2t)i 
where  Plt  =  ±(l,i2_  lf  •  •  •  ,ft2_    ,et_  ^-a,  •  •  •  ,it-P-  i^t-p)  and  At  =  -TV**-  n  ■ ' '  >  ht-<,)- 

The  special  cases  where  the  null  model  is  quite  restricted  are  handled  easily  by  setting 
some  parameter  vectors  to  zeros.  The  Engle's  (1982)  LM  test  for  the  ARCH(p)  process 
is  obtained  by  imposing  some  restrictions  such  that  (f>  =  0,  6  =  0  and  the  diagonality  of 
E, .  A  LM  test  for  H0  :  7X  =  •  •  •  =  7P  =  0  is  NR2 ,  where  R2  is  calculated  from  the  OLS 
regression  of  i2  on  (l,i2_1,  •  •  •  ,£?-?)•  ^  ^ne  autocorrelation  process  is  present  under  the 
null  hypothesis,  all  we  should  do  for  constructing  the  test  statistic  is  to  estimate  the  null 
model  and  replace  the  dependent  variable  of  our  artificial  regression  i2  by  v2 .  In  Table 
3,  we  summarize  the  appropriate  dependent  variable  and  regressors  for  the  artificial  OLS 
regression  for  some  special  cases  which  are  of  practical  interest.  As  easily  seen  in  Table 
3,  the  presence  of  some  kinds  of  conditional  heteroskedasticity  under  the  null  hypothesis 
requires  a  normalizing  factor  for  the  dependent  variable  and  regressors. 

From  our  general  derivation,  it  also  follows  that  for  the  null  model  ARCH(p),  the 
LM  statistic  against  GARCH(q,p)  is  the  same  as  the  LM  statistic  against  ARCH{p  +  q). 
As  discussed  in  detail  in  Bollerslev  (1986),  we  observe  that  in  our  framework  the  LM  test 
for  the  white  noise  error  process  against  the  GAARCH{q,p)  or  GARCH(q,p)  process  is 
not  available  since  under  the  null  hypothesis  the  matrix  (Pi,P7)  becomes  singular.  These 
phenomenon  are  quite  similar  to  those  which  occur  in  testing  the  white  noise  against  the 
ARM  A  process  in  time  series  analysis  [see  Hannan  (1970),  Breusch  (1978)  and  Godfrey 
(1978)]. 
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4.3  LM  Tests  for  Autocorrelation  in  the  Presence  of  Conditional  Heteroskedasticity 

In  the  time  series  framework,  Milhoj  (1985)  found  that  the  variance  of  usual  estima- 
tors for  autocorrelation  could  be  increased  considerably  when  ARCH  effect  is  present. 
This  implies  that  the  traditional  test  statistics  which  are  significant  may  turn  out  to  be 
insignificant  in  the  presence  of  the  ARCH  type  effect.  Recognizing  this  point,  Diebold 
(1986)  suggested  the  modified  Box-Pierce  and  Box-Ljung  tests  for  autocorrelation  which 
incorporate  the  ARCH  effect.  Here  we  should  note  that  Diebold's  ARCH  -corrected  test 
statistics  are  based  on  the  sample  autocorrelation.  In  this  section,  we  propose  simple  LM 
statistics  for  the  autocorrelation  error  process,  in  regression  framework,  which  take  into 
account  of  the  presence  of  a  particular  form  of  conditional  heteroskedasticity. 

Noting  that  regressors  xt  in  the  model  (2.1)  include  lagged  dependent  variables,  we 
rewrite  it  as 

yt  =x'lt/3l  +x'2tP2  +et  (4.9) 

where  ilt  =  (yt_  x ,  •  •  •  ,yt_m )'  is  a  m  x  1  vector  of  lagged  dependent  variables,  i2t  is  a  A;  x  1 
vector  of  exogenous  variables,  and  Pl  =  (/?X1 ,  •  •  •  ,/?lm )'  and  P2  are  unknown  coefficient 
vectors  corresponding  to  xlt  and  x2t,  respectively.  Let  L  denote  the  lag  operator.  It  is 
assumed  that  all  the  roots  of  the  lag  operator  polynomial  Px  (L)  =  1  —  YlT=i  PuL*  =  0  lie 
outside  the  unit  circle. 

To  simplify  the  information  matrix  for  the  mean  parameter  vector  I6l ,  where  0X  = 
(P[,P'7,<f>')' ,  under  the  assumption  of  no-autocorrelation,  we  take  conditional  expectations 
iteratively  for  each  element  of  I0l .  Then  we  have 
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where  <pk  is  the  fcth  coefficient  of  the  power  series  expansion  of  the  inverse  of  lag  operator 
polynomial,  i.e.  [/^(L)]-1  =  Yl°°=o  PjL3  with  <p0  =  1.  Putting  these  results  together,  we 
write  I0l  as 
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t=i      L  htr *      htli* 
where  Clt  =  diag(e2_  limmm, e?_r)  and  Ft  is  a  r  x  (m  +  k)  matrix  such  that 
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Note  that  the  null  model  to  be  estimated  is  a  linear  regression  model  with  the 
GAARCH(q,p)  disturbance  process.  After  estimating  the  null  model,  let  it  —  yt  —  x'tj3, 
ht  =  a\  +*{ Zt  -\-8'Wt  and  Qt  =  diag{i1_x^-  •  ,i*_r).  Then  the  basic  results  can  be  stated 
as  Proposition  4. 


PROPOSITION  4.    Denote  the  standardized  residua/  et__, ,-  =  it_}/\/ht,     j  =  0,1,2, 


the  standardized  regressors  it  =  xt/\/ht  for  all  t,  i±=  (£t-i ,  ■  •  ■  ,£t-r)',  fit  =  r-Ht  and 
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Ft   =  —Ft.    Then  the  LM  statistic  for  testing  the  null  hypothesis  H0   :  4>  =  0  in  the 
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presence  of  the  GAARCH(q,p)  disturbance  process  is 
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PROOF:    The  score  vector  for  the  autocorrelation  parameters  evaluted  at  the  MLEs  under 
the  null  hypothesis  is 
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Applying  a  formula  for  the  inversion  of  the  partitioned  matrix  to  equation  (4.10),  we  obtain 
its  variance-covariance  matrix  as 
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gives  the  result.  Q.E.D. 

Under  the  null  hypothesis,  LMAR\GAARCH  is  asymptotically  distributed  as  a  x2  with  r 
degrees  of  freedom.  It  is  easy  to  obtain  the  test  statistics  of  LMA r\garch  ■>  LMA r\AARch 
and  LMAR\ARCH  as  special  cases  of  LMAR\GAARCH  .  They  differ  only  in  the  functional 
form  of  conditional  variance.  If  no  lagged  dependent  variable  is  included  as  a  regressor, 
i.e.  Pi  =  0m  x ! ,  the  information  matrix  for  the  mean  parameters  is  also  block  diagonal 
between  07  and  <f>.  In  this  case,  LMAR\GAARGH  takes  much  simpler  form  as 
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Furthermore,  if  we  remove  the  effect  of  conditional  heteroskedasticity  by  putting  7  =  0 
and  6  =  0,  the  usual  LM  statistic  for  autocorrelation  (LMAR)  proposed  by  Breusch  (1978) 
and  Godfrey  (1978)  is  readily  obtained.  The  null  model  to  be  estimated  is  a  standard 
linear  regression  model  with  the  white  noise  error.  If  we  replace  ht  by  ^  Ylt=  1  ^t  >  tnen  a 
consistent  estimate  of  I6l ,  denoted  by  I$l ,  is  given  by 


V-1      NF' 
NF'      NIr 

where  V  is  the  variance-covariance  matrix  of  the  OLS  estimators  /?  and 
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Let  ffc  =  J2t=i  ^  ^ -  k  I  ^<  =  1  ^t  anc^  define  f  =  (fx ,  •  ■  • ,  fk )' .  It  is  easily  seen  that  the 
score  vector  for  autocorrelation  parameters  is  Nf.  Then  we  get 
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which  is  exactly  the  same  as  the  equation  (23)  in  Breusch  (1978).  From  the  above  result, 
the  familiar  LM  statistic  for  autocorrelation  when  there  is  no  lagged  dependent  variable  in 
regressors  {LM'AR)  is  easily  obtained  as  Nf'f  since  in  this  case  F*  is  a  null  matrix.  LMAR 
and  LM\R  will  have  an  asymptotic  x2  distribution  with  r  degrees  of  freedom  when  the 
null  model  is  true. 

5.  AN  ILLUSTRATIVE  EXAMPLE 

The  effect  of  inflation  volatility  on  real  economic  variables,  such  as  output  and  em- 
ployment, etc.,  has  been  much  debated  over  the  recent  years  [see,  for  example,  Friedman 
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(1977),  Levi  and  Makin  (1980),  Mullineaux  (1980),  Evans  (1983),  and  Coulson  and  Robins 
(1985),  etc.].  In  studying  this  issue,  measuring  the  variability  of  inflation  has  appeared  as 
an  important  task.  Various  methods  for  measuring  it  have  been  proposed.  Among  them, 
we  only  focus  on  a  method  based  on  a  paricular  parameterization  in  this  section.  In  an 
influential  paper,  Engle  (1983)  used  the  ARCH  specification  to  estimate  the  conditional 
variance  of  inflation  from  the  U.S.  quarterly  data  over  1947  IV-1979  IV,  and  investigated 
whether  higher  rates  of  inflation  are  associated  with  higher  variability  of  inflation.  Specif- 
ically, he  estimated  the  following  reduced  form  equation  of  inflation 

A=A+/?2(A-i)+/?3(A-2)  +  ^(PMt_1) 

+  MWt-i)+MMt-i)  +  Pi(t)  +  et  (5.1) 

3=1      V  ' 

where  the  variables  P,  PM,  W  and  M  are  the  rates  of  changes  of  a  price  index  (the 
GNP  deflator),  an  import  price  index,  a  wage  index,  and  the  money  supply,  respectively. 
This  inflation  equation  includes  two  lagged  dependent  variables  (Pt-i  and  Pt_2),  and  the 
conditional  variance  ht  is  assumed  to  exhibit  the  two-parameter  ARCH  process  of  eighth- 
order  with  linearly  declining  weights.  Using  this  model,  Engle  estimated  the  conditional 
variances  of  U.S.  inflation  over  the  past  three  decades.  His  main  findings  were  that  (i)  the 
variance  of  inflation  in  the  1970's  was  only  slightly  greater  than  that  in  the  1960's,  (ii)  the 
variance  of  inflation  in  both  the  1960's  and  1970's  was  well  below  that  in  the  late  1940's 
and  early  1950's,  and  (iii)  on  the  contrary  to  a  popular  belief,  the  high  level  of  inflation  in 
the  1970's  was  not  associated  with  the  high  variability  of  inflation. 

Engle  performed  a  variety  of  specification  tests  based  on  the  least  squares  residu- 
als. Engle's  ARCH  tests  and  White's  general  heteroskedasticity  tests  strongly  reject  the 
hypothesis  of  i.i.d.  errors,  indicating  a  possibility  of  the  presence  of  ARCH  and  uncondi- 
tional heteroskedasticity.  However,we  note  that  Engle's  specification  tests  focused  mainly 
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on  the  second  moment  of  the  error  term  and  the  problem  of  autocorrelation  was  not  ex- 
plicitly discussed.  Also  we  note  that  the  diagnostic  tests  for  checking  the  adequacy  of  the 
estimated  model  were  not  reported.  In  this  section,  using  Engle's  data  provided  by  the  ed- 
itorial office  of  the  Journal  of  Money,  Credit  and  Banking  we  re-examine  the  distributional 
structure  of  the  error  term  in  the  model  (5.1),  and  re-estimate  the  conditional  variance  of 
U.S. inflation.  Since  our  main  purpose  is  to  illustrate  some  aspects  of  modeling  conditional 
heteroskedasticity,  we  do  not  make  any  attempt  to  modify  Engle's  model  (5.1)  and  take  it 
as  given. 

Table  4  presents  the  estimation  results  of  various  models.  The  rationale  behind  the 
Models  (4)-(6)  will  be  clear  from  the  subsequent  discussion.  The  MLEs  for  Models  (3)-(6) 
were  obtained  by  using  ZXMIN,  an  optimization  subroutine  of  International  Mathemat- 
ical Statistical  Library.  Although  the  money  supply  variable  (Mt_i)  is  not  significant  in 
all  models,  it  is  left  for  its  economic  importance.  As  explained  in  Engle  (1983),  its  indirect 
influence  on  inflation  could  be  substantial  through  the  effect  on  wages  and  import  prices. 
The  LM  statistics  for  testing  the  presence  of  ARCH ,  AARCH  and  AR  were  calculated 
by  running  auxiliary  regressions  summarized  in  Table  3  and  are  reported  in  Tables  5,  6 
and  7.  These  results  clearly  show  that  there  is  a  very  close  interaction  between  autocor- 
relation and  conditional  heteroskedasticity.  The  LM  tests  for  ARCH,  AARCH  and  AR 
based  on  the  OLS  residulas,  which  are  given  in  the  second  columns  of  the  above  tables, 
indicate  the  simultaneous  presence  of  autocorrelation  and  conditional  heteroskedasticity. 
However,  we  should  note  that  these  tests  are  statistically  sensitive  to  the  presence  of  a  par- 
ticular form  of  autocorrelation  or  conditional  heteroskedasticity.  Interestingly,  as  shown 
in  Table  6,  the  AARCH  specification  is  quite  evident.  In  particular,  the  LM  tests  for  the 
AARCH  specification  (5)  is  found  to  be  significant  irrespective  of  the  presence  of  AR(<f>1 ) 
or  AR{<f><).  Table  7  shows  that  only  the  LM  test  for  the  first-order  autocorrelation  in 
the  presence  of  AARCH (i4i~i7,~f4/r)  is  significant  at  a  1  %  level.  Given  these  results,  it 
appears  that  the  AARCH (74,77, 74.7)  combined  with  AR((j>i)  may  be  an  acceptable  spec- 
ification of  the  error  term.  Correspondingly,  it  is  shown  that  all  the  MLEs  of  the  AR{<f)x) 
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and  AARCH ('74,77,74.7)  coefficients  are  significant  as  reported  in  Table  4.  Presence  of 
seventh-order  lag  and  its  interaction  with  the  fourth-order  lag  in  our  AARCH  specifica- 
tion is  somewhat  awkward.  This  might  be  due  to  not-so-perfect  specification  of  the  Model 
(5.1).  In  a  recent  comment  on  Engle's  study,  Cosimano  and  Jansen  (1988)  found  that  M 
enters  with  seven  lags  instead  of  one  [see  also  Engle's  (1988)  reply].  We  also  experimented 
with  other  possible  specifications  for  the  autocorrelation  and  conditional  heteroskedastic- 
ity  structures.  However,  as  explained  below,  the  above  specification  was  found  to  be  quite 
satisfactory. 

Relative  to  Engle's  (1983)  ARCH  model,  Model  (6),  where  the  AARCH  is  combined 
with  AR,  gives  significantly  increased  log-likelihood  value  of  509.452  compared  to  499.504. 
Furthermore,  as  illustrated  in  Tables  8,  9  and  10,  the  diagnostic  test  statistics  based  on 
the  standardized  residulas  for  Model  (6)  are  generally  more  satisfactory  than  those  for 
the  OLS  and  pure  ARCH  models.  From  Table  8,  we  observe  that  there  is  significant 
first-order  serial  correlation  in  the  ARCH  model,  while  for  Model  (6),  autocorrelation, 
though  not  completely  absent,  is  less  prominant.  The  autocorrelation  tests  for  the  squared 
standardized  residuals  in  Table  9  also  provide  a  clear  evidence  of  the  advantage  of  Model 
(6)  over  the  other  two  models.  Table  10  provides  White's  (1980)  tests  for  unconditional 
heteroskedasticity  and  Jarque  and  Bera's  (1987)  LM  tests  for  normality.  The  results  show 
that  Model  (6)  does  not  suffer  from  the  presence  of  unconditional  heteroskedasticity  and 
also  does  not  reject  the  hypothesis  of  conditional  normality  of  the  error  term,  whereas  the 
ARCH  model  gives  a  slight  evidence  of  departure  from  normality. 

Lastly,  comparing  the  estimates  of  conditional  variance  of  inflation  from  Model  (6) 
with  those  from  the  Engle  model,  we  investigate  whether  or  not  the  conditional  variance 
of  inflation  exhibited  systematic  differences  over  the  past  three  decades,  and  examine  the 
structure  of  the  variability  of  inflation  by  establishing  their  maximums  and  minimums. 
Here,  we  focus  on  the  four  periods  which  are  195HV-1954II  (the  period  of  the  Korean  war 
price  controls),  1954III-1959IV  (the  period  of  the  normalization  after  the  Korean  war), 
1962I-1968IV  (the  period  of  the  Guideposts)  and  1973III-1979IV  (the  period  of  decontrol 
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after  the  Nixon  freeze  of  1971).  Table  11  provides  the  average  conditional  variance  of 
inflation  for  each  of  these  periods.  The  results  show  that  except  for  the  turbulent  early 
1950s  the  average  conditional  variance  from  Model  (6)  is  slightly  greater  than  those  from 
the  ARCH  model,  but  the  overall  patterns  of  two  different  estimates  are  basically  the 
same.  However,  we  note  that  these  two  conditional  variance  estimates  of  inflation  behave 
in  a  quite  different  way.  As  shown  in  Figures  2  and  3,  the  conditional  variances  from  Model 
(6)  fluctuates  very  frequently  while  those  from  the  ARCH  model  generates  a  very  smooth 
pattern.  In  particular,  the  conditional  variances  from  Model  (6)  in  the  early  1950s  and 
the  late  1970s  show  some  sharp  fluctuations.  The  figures  also  indicate  that  the  ARCH 
model  underestimated  the  conditional  variances  of  inflation  during  these  periods.  Some 
other  interesting  differences  between  two  conditional  variance  estimates  cna  be  observed 
from  Table  12  which  presents  their  maximum  and  minimum  in  each  period.  The  results 
also  demonstrate  that  the  pure  ARCH  model  provides  lower  estimates  of  the  conditional 
variance  of  inflation  in  comparison  with  Model  (6).  In  all  the  periods,  the  maximums 
of  the  conditional  variances  from  Model  (6)  are  considerably  higher  than  those  from  the 
ARCH  model  and  the  minimums  from  Model  (6)  are  somewhat  lower.  Therefore,  the 
Model  (6)  yields  much  greater  ranges  in  variability  of  inflation  in  all  periods  than  those  in 
the  Engle  model.  In  particular,  the  range  in  the  period  of  1970s  from  Model  (6)  is  5.0225 
which  is  substantially  greater  than  1.2332,  the  range  from  the  ARCH  model.  This  result 
provides  an  evidence,  albeit  weak,  for  the  argument  that  the  higher  rate  of  inflation  in 
the  late  1970s  was  associated  with  the  higher  variability  of  inflation.  However,  we  find  a 
strong  evidence  for  Engle's  other  finding  that  the  variance  of  inflation  in  the  both  1960's 
and  1970's  was  well  below  that  in  the  early  1950's.  Finally,  it  is  interesting  to  observe 
from  Table  12  that  except  for  one  case  Model  (6)  has,  with  some  time  lag,  the  quarter 
in  which  the  maximum  or  minimum  of  the  conditional  variance  in  each  period  occurs  in 
comparison  with  the  ARCH  model.  To  summarize,  when  the  AR  process  is  taken  into 
account,  we  might  get  a  different  conditional  heteroskedasticity  specification  which  yields 
different  estimates  of  conditional  variances. 
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6.  CONCLUDING  REMARKS 

In  this  paper,  we  have  attempted  to  provide  a  unified  framework  to  explore  the 
stationaxity  conditions  and  the  testing  problems  for  a  general  form  of  conditional  het- 
eroskedasticity  which  encompasses  AR,  ARCH  and  GARCH  processes  as  special  cases. 
We  demonstrated  that  these  issues  could  be  easily  handled  by  adopting  a  random  coeffi- 
cient approach.  Our  analysis  shows  that  a  stationary  conditional  heteroskedasticity  process 
may  not  be  stationary  in  the  presence  of  autocorrelation  and  the  LM  tests  for  a  particular 
form  of  conditional  heteroskedasticity  or  AR  based  on  the  OLS  residuals  are  sensitive  to 
the  presence  of  a  particular  form  of  AR  or  conditional  heteroskedasticity.  Our  illustrative 
example  demonstrates  that  in  a  dynamic  time  series  context  misspecifying  the  conditional 
heteroskedasticity  or  negelecting  the  autocorrelation  might  not  provide  reliable  inferences. 
Therefore,  for  models  where  both  conditional  heteroskedasticity  and  serial  correlation  are 
present,  more  extensive  research  is  needed  for  drawing  a  clearer  picture  on  their  interaction 
and  the  discrimination  between  them.  The  considerations  of  higher-order  moment  struc- 
tures, forcasting  performances  and  consequences  in  estimation  might  be  some  interesting 
areas. 
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Table  1:    Specifications  of  the  Disturbance  Processes 


4> 

sP 

A, 

Disturbance  Process 

t  =  opxl 

Sp  =  0pXp 

A,  =  °«x« 

white  noise 

<t>  =  opxl 

Ep:diagonal 

A,  =  0qXq 

ARCH 

4>  =  %*i 

Ep:  not  diagonal 

A,  =  0qXq 

AARCH 

«^  =  opX1 

Ep:diagonal 

A^diagonal 

GARCH 

«^  =  opxl 

Ep:not  diagonal 

A^diagonal 

GAARCH 

<^opxl 

Ep  —  Opyp 

A,  =  0qXq 

AR 

4>^oPxi 

Epidiagonal 

A,  =  0<,x, 

AR  and  ARCH 

t^Opxi 

Ep:not  diagonal 

A,  =  0,x, 

AR  and  AARCH 

4>^%xi 

Ep:diagonal 

A^tdiagonal 

AR  and  GARCH 

*#opX1 

Ep:not  diagonal 

A,;:diagonal 

AR  and  GAARCH 

Table  2:    Interaction  between  Autocorrelation  and  Conditional  Hetroskedasticity* 


Case 


No  Autocorrelation 


The  First-order  Autocorrelation 


ARCH{\) 

GARCH{1,1) 

GARCH(2,1) 


0  <  7i  <  1 

0  <  7i  +  Si  <  1 

0  <  7i  +  <*i  +  h  <  1 


1±T7<    1 


(1-*?) 


(T^TT  +  *i  +  **  <  l 


*  It  is  assumed  that  the  regularity  conditions  0  >  71  >  0  and  0  >  6,  >  0,  t '  =  1,  2  are  satisfied  and  also  that 
the  first-order  autocorrelation  process  is  stationary,  i.e.  |  <f>i  |<  1. 


Table  3:    LM  Tests  for  Conditional  Heteroskedasticity  Specifications 


Null  Model 


Alternative  Model 


Dependent  Variable         Regressors* 


AARCH{p)  +  AR{r)         GAARCH{q,  p)  +  AR{r)         j£  _  i 


ARC  Hip)  +  AR{r)  GARCH(q,p)  +  AR(r)  ^- -  1 


AR(r) 

AR{r) 
AARCH[p) 
ARCH[p) 
white  noise 
white  noise 


AARCH{p)  +AR(r) 

ARCH{p)  +  AR{r) 

GAARCH{q,p) 

GARCH{q,p) 

AARCH{p) 

ARCH 


&"1 


g- 


it[iu2(p):i212(p):k1(q) 


ht 


\£u 


!(P  +  ?)] 


[£u2(p):£2t2(p)j 


liulp)] 
±[ii±(p)--hi(p)--k(<i) 


r-[£u2(p  +  ?)] 


[i^^-.i^ip)} 


liu2(p)) 


*  For  any  non-negative  integer  j,  we  define  the  following  vectors:   eu2(j)  =  (l,i2_1,  •  •  • ,  e2_  •),  e?t2{j) 
[et-iit-2,  ■■  ,£t-j-iet-j)  and  htfj)  =  {ht-i,  ■  ■  ■ ,  At-y). 


Table  4:    Parameter  Estimates  of  Various  Models"/ 


Parameter 


[1)  OLS 


(2)  Engle's  (1983)  ARCHbl         (3)  MLE  of  Engle's  (1983)  ARCHCI 


fil 

.00002348(0.021) 

.000060(0.07) 

fa 

.30690000(3.333) 

.330000(4.10) 

fa 

.02522500(0.279) 

.200000(2.60) 

h 

.07330000(3.070) 

.060000(3.80) 

fa 

.17305000(2.664) 

.160000(3.50) 

fa 

.05636000(0.778) 

.050000(0.90) 

fa 
k 

a2 

.00004155(2.457) 

.000020(1.40) 

.000006(2.70) 

i 

.560000(2.70) 

74 

77 

74.7 

-.00064382(0.715) 
.21346086(7.990) 
.20835960(5.194) 
.07675567(5.038) 
.16599867(4.180) 
.01081852(0.199) 
.00004477(2.848) 

.00000539(3.057) 
.61439672(4.020) 


h{e) 


496.964 


499.504 


502.486 


a/  Values  in  parentheses  are  ^-statistics. 

6/  Engle's  (1983)  estimates  obtained  by  the  scoring  algorithm. 

c/  Maximum  likelihood  estimates  of  the  Engle's  (1983)  ARCH  model  obtained  by  ZXMIN. 


Table  4:    Parameter  Estimates  of  Various  Models  (continued) 


Parameter 

(4)  AARCH{l4tl7,H.7) 

(5)  AR{ti) 

(6)  AARCH{i4,l7,lA.7)  +  ARit!) 

A 

-.00083114(1.220) 

-  .00037046(0.434) 

-.00081351(1.447) 

ft 

.10363771(11.021) 

.29152412(4.599) 

.40815292(6.014) 

h 

.29127647(8.863) 

-.03075479(0.540) 

.13280371(5.372) 

h 

.05383105(10.925) 

.09232503(5.483) 

.05155577(4.845) 

h 

.21175006(80.885) 

.17371490(4.052) 

.20998323(5.992) 

h 

.00207159(0.058) 

.03256405(0.745) 

.01641314(1.125) 

A 

.00004644(5.162) 

.00005533(4.283) 

.00002534(3.018) 

k 

-.08242327(1.376) 

-.35050454(8.795) 

a2 

.00000724(5.105) 

.00002197(8.185) 

.00000689(4.704) 

7 

74 

.24207686(39.253) 

.36023781(4.342) 

77 

.28479854(15.306) 

.16206898(2.326) 

74.7 

-.18854743(18.375) 

-.19542229(4.888) 

In{6) 

506.101 

504.834 

509.452 

Table  5:    LM  Statistics  for  ARCH  in  the  Presence  of  AR' 


lag                                            LMaRCH  LMARCH\AR{<i>l)  LMARCH\AR(4>t) 

1  3.7376  8.4709*  1.7732 

2  1.7526  6.8922*  5.0553 

3  5.4180  4.3375  3.2086 

4  21.7250*  3.1372  0.3509 

5  4.8732  1.2546  3.8400 

6  3.8499  4.1358  3.0583 

7  10.1260*  15.7784*  18.8800* 

8  0.7986  2.8200  1.1232 

*  Values  are  the  LM  statistics  for  individual  lag  components  which  follow  an  asymptotic  x2  distribution 

with  1  degree  of  freedom. 

t  denotes  the  statistical  significance  at  a  1  %  level. 


Table  6:    LM  Statistics  for  AARCH  in  the  Presence  of  AR 


AARCH  specification 

LM AARCH 

LMAARCH\AR(4>i) 

LMAARCH\AR{4>t) 

(I)  AARCH(lin2, 11.2) 

12.7889* 

15.0318* 

5.3874 

(2)AARCH(lul2,l3, 

20.6136* 

19.6000* 

9.7356 

7l.2,  71.3,72.3) 

(3)AARCH(lul2,l3n<, 

43.3625  * 

24.7008* 

11.4587 

71.2.  71.3,  71.4, 

72.3,72.4,73.4) 

[A)AARCH{lulA,llA) 

30.5625* 

9.0148 

2.2385 

{5)AARCH(lin7n4,7) 

12.2952* 

17.0973* 

18.9390* 

X  denotes  the  statistical  significance  at  a  1  %  level. 


Table  7:    LM  Statistics  for  AR  in  the  Presence  of  AARCH' 


lag 


LM 


AR 


LMAR\AARCH(iu"H,"li.t) 


LMAR\AARCH{nA,*n,Tt,i) 


1 

2.8800 

2 

3.5560 

3 

9.7020* 

4 

10.8000* 

5 

3.8440 

6 

3.4071 

9.1512* 
6.6789* 
9.4062* 
6.1468 
5.6880 
6.1523 


7.1148* 
2.5440 
4.6172 
2.7022 
2.3049 
2.4128 


*  Values  are  the  LM  statistics  for  individual  lag  components  which  follow  an  asymptotic  x2  distribution 

with  1  degree  of  freedom. 

\  denotes  the  statistical  significance  at  a  1  %  level. 


Table  8:    Autocorrelation  of  OLS  and  Standardized  Residuals* 


lag 


(1)  OLS 


(2)  Engle's  (1983)  ARCH 


(6)  AARCH{l4,l7,l4.7)+AR{4>i) 


1 

-0.08425 

2 

-0.04975 

3 

0.16745 

4 

-0.22751 

5 

-0.10233 

6 

-0.05596 

7 

-0.11861 

-0.21561 
-0.10370 
0.19637 
-0.03572 
-0.05209 
0.10657 
-0.03696 


-0.04023 
-0.18714 
0.18758 
-0.03302 
-0.06739 
0.04504 
0.01180 


*  The  approximate  standard  error  for  these  autocorrelations  is  0.09. 


Table  9:    Autocorrelation  of  Squared  OLS  and  Standardized  Residuals* 


lag 


(1)  OLS 


(2)  Engle's  (1983)  ARCH  (6)  AARCH (74,77,74.7)  +  AR{4>1) 


1 

0.12844 

2 

0.08827 

3 

0.15589 

4 

0.31264 

5 

0.13157 

6 

0.11514 

7 

0.18824 

-0.07887 
-0.11331 
0.05707 
-0.01474 
-0.15256 
-0.05265 
-0.21972 


0.04168 
-0.01512 
0.07700 
-0.09261 
-0.08476 
0.04188 
-0.06190 


*  The  approximate  standard  error  for  these  autocorrelation  is  0.09. 


Table  10:    Tests  for  Unconditional  Heteroskedasticity  and  Normality"/ 


residuals 


White's  Test  for  Unconditional         Jarque  and  Bera's  LM  Test  for 
Heteroskedasticity6'  Normality0' 


(1)  OLS 

(2)  Engle's  (1983)  ARCH 

{£)  AARCHi^m^tj)  +  AR{4>,) 


74.2266* 
21.1536 
38.4100 


117.0170* 
4.7446* 
2.1119 


a/  \  and  *  denote  the  statistical  significance  at  1  %  and  10  %  levels,  respectively. 

6/  White's  test  for  unconditional  heteroskedasticity  follows  an  asymptotic  x7  distribution  with  28  degrees 

of  freedom. 

c/  Jarque  and  Bera's  LM  test  for  normality  follows  an  asymptotic  x2  distribution  with  2  degrees  of  freedom. 


Table  11:    Average  Conditional  Variance  of  Inflation  for  Four  Periods"''6''0' 


variance 


1951IV-1954II 


1954III-1959IV 


19621- 1968IV 


1973III-  1979IV 


ARCH  variance 

5.1012 

1.5388 

1.0256 

1.2665 

(Engle's(1983)  ARCH) 

(2.2586) 

(1.2405) 

(1.0127) 

(1.1254) 

AARCH  +  AR  variance 

5.0608 

1.6463 

1.0692 

1.3292 

(Model  (6)) 

(2.2496) 

(1.2831) 

(1.0340) 

(1.1529) 

a/  For  period  i,  average  conditional  variance  was  calculated  by  ^-  £2y=i  k*/i  wnere  ^«  is  the  number  of 
quarters  in  period  i  and  hij  is  the  estimated  conditional  variance  for  the  jth  quarter  in  period  t,  t  =  1,  2,  3,  4. 
6/  All  variances  have  been  scaled  by  105. 
c/  Standard  deviations  calculated  as  a  square  root  of  average  variances  are  provided  in  parentheses. 

Table  12:    Maximum  and  Minimum  Conditional  Variances  of  Inflation  for  Four  Periods'1/'6/ 


195HV-1954II     1954III-1959IV     1962I-1968IV     1973III-1979IV 


ARC H  variance  maximum(A) 

(Engle's(l983)  ARCH) 

minimum(B) 

A-B 


9.6628 
(1951IV) 

2.2442 
(1953IV) 

7.4186 


3.8356 

1.1951 

2.0359 

(1954IV) 

(1965II) 

(1978III) 

0.7572 

0.8576 

0.8027 

(1957II) 

(1962IV) 

(1977III) 

3.0784 

0.3375 

1.2332 

6.9091 

1.4706 

5.7175 

(19551) 

(19661) 

(1979II) 

0.7167 

0.7030 

0.6950 

(19581) 

(1963II) 

(19781) 

6.1924 

0.7676 

5.0225 

AARCH  +  AR  variance     maximum(C) 
(Model  (6)) 

minimum(D) 


C-D 


23.7999 

(1952II) 

1.1905 

(1951IV) 

22.6094 


a/  All  variances  have  been  scaled  by  10s. 

6/  Corresponding  quarters  to  conditional  variances  are  given  in  parentheses. 


Figure  1:  Stationarity  Region  of  GARCH(l,l)  in  the  Presence  of  Autocorrelation 


Figure  2:  Estimates  of  the  Conditional  Variance  of  Inflation 
From  the  ARCH  Model  (195HV-1979IV) 
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Figure  3:  Estimates  of  the  Conditional  Variance  of  Inflation 
From  the  AARCH+AR  Model  (1951IV-1979IV) 
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